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1. Introduction 

Spurred by the discovery of high temperature superconductivity [I], the last few years have 
seen intense activity in the subject of two-dimensional quantum antiferromagnets. In par- 
ticular, much attention has been focussed upon understanding the structure of quantum 
disordered phases of such antiferromagnets [2] and their possible relationship to high tem- 
perature superconductivity [3]. Large N expansions 4 J on unfrustrated antiferromagnets 
found columnar spin-Peierls order in the disordered state for half-integer spins ]E1 EH II]- 
"Chiral" [HJ and "spin-nematic" [0] states are among the new structures that have been 
proposed as ground states of frustrated quantum antiferromagnets. 

This paper presents details of a new systematic analytic technique for frustrated and 
doped antiferromagnets (AFMs) which has been proposed recently [10] ■ The method relies 
on a large N expansion based upon models with symplectic symmetry (Sp(N)). The method 
is applied in this paper to two models: 

(i) A square lattice AFM with first, second and third neighbor antiferromagnetic coupling 
- the J1-J2-J3 model. This model has been studied elsewhere by numerical fUE], series- 
expansion ^3], and mean-field Jl] methods; we will compare our results with these studies 
later. A particular strength of our approach is that it makes the connection between the 
structure of the known classically ordered phases and the quantum disordered phases espe- 
cially clear. It will also clarify the appearance of "or der-from- disorder" ^H] from quantum 
fluctuations for models which are classically disordered. We will find new quantum disor- 
dered phases which have unconfined bosonic spin-1/2 spinon excitations. 

(ii) The square lattice t — J model. We will present initial results in the mean field N = 00 
limit at T = 0. We find superconducting ground states similar in structure to those of 
Ref HE|. 
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We begin by motivating the use of a symplectic large N expansion for frustrated AFMs. 
Previous large N methods have been based on the SU(N) generalization of the SU(2) 
AFM jHIHllZj and have been restricted to unfrustrated AFMs with a two sublattice structure 
(labeled A, B) for reasons we now explore. "Spins" are placed on sublattice A forming an 
irreducible representation of SU(N) while those on B form the conjugate representation. 
Thus e.g. totally symmetric representations on sublattice A can be can be formed [3] by 
placing n& bosons created by b\ a where a = 1 . . . N and i G A; the b a bosons transform 
under the fundamental representation of SU(N). The conjugate representation is placed 
on sublattice B by n b bosons created by &j Q for j G B; the b a bosons transform under the 
representation conjugate to the fundamental. The use of conjugate representations ensures 
a natural pairing between directions in spin space on the two sublattices. The only possible 
coupling between sites on opposite sublattices which is invariant under SU (N) and bilinear 
in the spin operators is 

- {b\ a bf)(b%,) (1) 

(For SU{2) this reduces to the usual Si ■ Sj plus a constant). In the classical limit (rib — > oo) 
this coupling will induce a Neel ground state 

nWn(S}T»- < 2 > 

In a system with strong quantum fluctuations, this coupling tries to maximize the number 
of valence bonds 

{blb] a ) |0) (3) 

between pairs of sites on opposite sublattices. The only bilinear coupling between sites on 
the same sublattice is the 'ferromagnetic' coupling 

-(&L^)(4X) ( 4 ) 
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which demands that the spins on sites i and i' point in the same direction. Reversing the sign 
of this term will favor states in which the spins point in any two unequal directions; this is 
quite different from the antiferromagnetic coupling which explicitly pairs directions in spin 
space. Interactions between sites on the same and opposite lattices are thus inequivalent 
and there is no natural way of introducing a democratic antiferromagnetic coupling between 
any two sites. Only for SU (2) do the ferromagnetic and antiferromagnetic couplings above 
become equivalent. 

A proper description of a frustrated AFM therefore requires that all the spins transform 
under the same representation of a group, and that two spins can combine to form a singlet. 
For SU(2) we can write bj a = e a pb^ [e aa ' = —e a ' a and = 1); the boson annihilation 
operators on all the sites now have an upper index. Singlet bonds e aa ' b\ c b^ a , can now be 
formed between any two sites. This structure has a natural generalization to the symplectic 
groups Sp(N) for all N. These are the groups of 2N x 2N unitary matrices U such that 



U T JU = J 



(5) 



where 



/ 1 
-1 



Jo.8 — J 



a/3 



(6) 



v •• ) 

is the generalization of the e tensor (note Sp(l) = SU(2)). This tensor can be used to raise 
or lower indices on other tensors; all representations are therefore self-conjugate. "Spins" 
can be created on each site by n b bosons b\ a where a = 1 . . . 2N. The bf bosons transform as 
the fundamental representation of Sp(N); the "spins" on the lattice therefore belong to the 
symmetric product of n b fundamentals, which is also an irreducible representation. Valence 
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bonds 

j aP iJ ja (7) 

can be formed between any two sites; this operator is a singlet under Sp(N) because of (j3J). 
An antiferromagnetic coupling should maximize the number of such bonds between two sites; 
we will therefore consider models described by the following Hamiltonian 

HAF = ~Y. J f {j-rsVtf) (8) 

i>j 

where i,j run over the sites of an arbitrary lattice, and Jjj are antiferromagnetic exchange 
constants. We recall the constraint 

b\X = n b (9) 
which must be imposed at every site. For the group Sp(l) this generates states with spin 
S = n b / 2 at every site. 

We now summarize the results obtained in our study of Haf for the model with nearest 
(Ji), second (J 2) and third (J3) neighbor interactions on the square lattice. The large N 
limit was taken with the ratio nb/N fixed; the results depend strongly on the value of rib/N. 
The phases found (Figs HI 121 HJ) can be separated into two distinct types: 

1. Commensurate, collinear phases 

These are closely related to those found in unfrustrated SU (N) AFMs jHl Ej • For large 
values of rib/N these states have magnetic long range order (LRO) with the spins polarized 
parallel or anti-parallel to each other. Upon reducing nb/N a transition eventually occurs 
to a corresponding short range ordered (SRO) phase, with a finite spin-correlation length. 
All the SRO phases are described at long distances and long times by the following effective 
action when the correlation length is not too small: 

_ A2 J} 

+ •••, (10) 



S e ff = I d 2 r [ df\- 



\g 



\{d,-iA,)z a \ 2 + ^\z a \ 2 



where r is the Matsubara time, c is the spin-wave velocity, f = cr, and \x runs over x, y, f. 
Spatial anisotropy can be also be present but has been neglected for simplicity. The action 
describes a complex field z a which transforms under the fundamental of Sp(N) and has 
a U(l) charge +1; this field is related to the lattice boson b a , although the form of the 
relationship varies in different phases. The U(l) gauge field is related to the phases of 
certain link-variables, and the gauge symmetry is compact. In the SRO phase, the mass A 
is finite and is proportional to the inverse spin-correlation length. The compact U(l) gauge 
field leads to confinement of the z quanta and Berry phases of its instantons (monopoles) j3] 
induce spin-Peierls order for special values of n& [Zj. The LRO phase is reached when A 
vanishes and z quanta condense in the k = state J7j. To characterize the LRO phases by 
a gauge-invariant order parameter, we consider the expectation value of the 'spin' operators 
s a = {z^S^pZ^ (S a is a generator of Sp(N)) across the transition. In the SRO phase these 
vanish as a result of Sp(N) invariance. In the LRO phase, the order parameter manifold, M co u 
will be given by Sp(N) modulo the subgroup which leave the s a invariant. Any orientation 
of the z condensate can be rotated by Sp(N) transformations such that (z a ) = z5 al . Now 
the s a are invariant under the group Sp(N — 1) acting on components a > 2. An additional 
factor of U(l) is obtained from the symmetry associated with rotations about the V axis in 
the a = 1, 2 subspace under which z 1 — ► z 1 e 1 ^' and z 2 — > z 2 e~ 1 ^. We have therefore 

M Sp{N) (11) 

McoU " U(l) x Sp(N - 1) (U) 

in direct analogy with U(N)/(U(1) x U(N — 1)) ^ CP N ~ l for the SU(N) models 0EB!; for 

iV = 1 we recover CP 1 (the unit sphere, S 2 ). The transition from LRO to SRO is expected 

to be described by a non-linear sigma (NLa) model on M co \\. We note that vr 2 (M co ii) = Z, 

the group of integers, so that topologically stable point defects in spacetime (hedgehogs) 

exist for all iV when the spatial dimension d = 2, while ~K\ = so there are no line defects. 
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2. Incommensurate phases 

Frustration induces phases with LRO and SRO in incommensurate helical spin configura- 
tions. All of the phases found favor planar arrangement of spins and there is no "chiral" 
order. In regions not too far from a commensurate phase these states are described at long 
distances and long times by the following effective action: 

S eff = JdPrJ^dff^ \{d^-iA^)z a \ 2 + ^\z a \ 2 +$■ (j a pz a VzP) + c .c. + y(<£) 

(12) 

The new feature is the presence of a charge —2 two-component scalar $ = (<3> x , <E> y ) related 
to lattice link fields which induce incommensurate order. The coupling between the z and 
$ is the simplest one consistent with global Sp(N) symmetry and is U(l) gauge invariant 
due to the antisymmetry of J (a coupling with no gradients of the form ^J a ^z a z^ vanishes 
identically). The potential V(€) is induced by short wavelength fluctuations; in the incom- 
mensurate phases V($) will have minima at a non-zero value of $ leading to a Higgs phase 
with ^ 0. All of phases found in this paper have at least two gauge inequivalent minima 
related to each other by a square lattice symmetry; this leads to a two-fold degeneracy which 
can only be lifted by explicitly breaking the square lattice symmetry in H^f- The minima 
are also such that (<& z ) and (<& y ) can simultaneously be made real in a suitable gauge. In 
such a gauge we see from Eqn (fT2"J) that the minima of the dispersion of the z a quanta are 
at wavevectors ko = ±g((<$> x ), ($ y ))/2. For finite A this leads to incommensurate SRO. 
The z a quanta have unit charge and will therefore be unconfined [F3\ in this Higgs phase: 
these SRO phases therefore possess unconfined bosonic spinons which transform under the 
fundamental of Sp(N) 20 for all values of the on-site 'spin' n b . In models which have the 
two-fold degeneracy lifted by small explicit symmetry breaking terms in Haf these results 
appear to contradict the 'fractional quantization principle' of Laughlin |2T]. As A — > 0, the z 



quanta will condense at k leading to incommensurate LRO. The order-parameter manifold 
is now 

M - SP{N) (13) 
Mnonco11 " Z 2 xSp(N-l) (13) 

because the U(l) invariance about the V axis has now been reduced to Z 2 as the spins 
are no longer collinear. This generalizes the result for N — 1, 5*0(3) = SU(2)/Z 2 pointed 
out previously [22 For M nonco n, 7r 2 = but 7Ti = Z 2 , so there are line defects in 

spacetime (vortex worldlines) for d = 2 in this case. Instantons and vortices are suppressed 
in the Higgs phase, so their Berry phases are not expected to lead to spin-Peierls order. 
However the Berry phases could induce additional intermediate phases between the Higgs 
and confinement phases: this will be briefly discussed later. 

The symplectic groups also have interesting applications to doped AFMs as described 
e.g. by a t — J model. In such a model, the hopping term transfers spin from site to site 
and so resembles the ferromagnetic coupling Thus in SU(N) models with conjugate 
representations on neighboring sites there is no simple SU(N) -invariant hopping term for 
N > 2; if instead one choses all sites with the same representation, hopping can be included 
but not antiferromagnetic exchange. Our symplectic approach allows inclusion of both ex- 
change and hopping for all N. In particular, using fermions with Sp(N) indices for spins 
and bosons for holes, the large N limit justifies the decoupling of Ref [TH] and produces 
superconductivity; phase separation into an insulating AFM and hole-rich superconductor 
is also present. Details of this analysis at N = oo and zero temperature are presented in 
Section 4. 

The outline of the rest of this paper is as follows. In Section 2 we introduce the general 
formalism of the Sp(N) large N limit for frustrated AFMs. Section 3 presents detailed 
results on the J\-J 2 -J^ model. Finally Section 4 discusses initial results on the t- J model. 



2. Frustrated Antiferromagnets 

We begin by setting up the general framework for the large- N expansion of antiferromagnets 
with Hamiltonian Haf (Eqn (jHJ). The large- N limit is taken with n^/N fixed to an arbitrary 
value. Depending upon the values of the J^- and of n b /N, the ground state of Haf m &y either 
break global Sp(N) symmetry and possess magnetic long-range-order (LRO) or be Sp(N) 
invariant with only short-range magnetic order (SRO). The structure of the large- N limit 
is very similar to the SU(N) case, and has been discussed extensively before [U U\ for the 
SRO states. We will therefore present details mainly in the LRO phases. The large N 
limit for these states is most conveniently taken by adapting the method of Brezin and 
Zinn- Justin [21]. We begin by introducing the parametrization 



We have introduced a natural double-index notation a = (m, a) with m = 1 . . . N and 
a =|, \. The index m = 2, . . . N. The x a field has been introduced to allow for a non-zero 
condensate = y/NS^xf; we will only consider models in which the condensate in the 

LRO phase can be transformed by a uniform global Sp(N) rotation into this form. We insert 
(JHJ) into Haf, decouple the quartic terms by Hubbard-Stratanovich fields Qij, and enforce 
the constraints by the Largrange multipliers Aj. This yields 

Hmf = E \ NJ ij \Qv\ 2 - JijQij^c \Nx?x? + E^f"' J + H. c. ) 



i>3 



i \ rh 



n b (15) 



The large iV limit is obtained by integrating over the 2(N — 1) b fields. The resulting effective 
action, expressed in terms of the Qij, Aj and x? fields, will have a prefactor of N (and some 
terms of order 1 which are sub-dominant) and is therefore well approximated by its saddle- 
point value. The Q,X,x fields are expected to be time-independent at the saddle-point 



and this is implicitly assumed in the following. The functional integral over the b requires 
knowledge of the eigenmodes of Hmf- This can be done along standard lines: we first solve 
the eigenvalue equation 

— £ JijQijVjfj, = w^Uin 
j 

E JijQijUin — XjVjfj, = UfjVjn (16) 

i 

for the N s (= number of sites in the system) positive eigenvalues and the corresponding 
eigenvectors (U^, V^J. The bosonic eigenoperators 7™ " 

77 = E Kb™ - ^'e^^kv) (17) 

i 

will diagonalize Hmf- The inverse relation is 

Zma \ y (tt _ ma rmm' uir'm.t A { 1 Q\ 

b i =Z^( f/ v7 M £ y^% m 'a') ( 18 ) 

Consistency of these relations imposes certain orthogonality requirements on (U, V). It can 
be shown using Eqn that these can always be satisfied. Finally the ground state energy, 
Emf of H M f is shown to be 

%^ = E 0; l%l 2 - JaQae^i^ + H. c.) - £ A, (l + | - |<| 2 ) + £ w„(g, A) 

(19) 

In the last term we have emphasized that the depend upon Q, A. Finding the ground 
state of Haf in the large N limit is now reduced to the problem of minimizing Emf with 
respect to the independent variables Qij, x® with the \ chosen such that the constraints 

^ = (20) 

are always satisfied. It is instructive to examine the equations obtained by demanding 
stationarity of Emf w.r.t x": 

E £ ™' JijQijxf + XiX* a = (21) 

3 
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This equation has two possible solutions: (i) xf = 0: this gives the SRO phases (ii) x\ 0: 
comparing Eqn (|2*Tj) with Eqn (JTfij) we see that this condition is equivalent to demanding 
that Eqn (jTfij) possess at least one zero eigenvalue. For finite rib, this will only occur in the 
limit N s — > oo, and implies the existence of gap less excitations. These are the Goldstone 
modes associated with the Sp(N) symmetry breaking. 

We now examine the large n^/N limit of Hmf] it is easy to show that Qij ~ Aj ~ nb/N 



while x" ~ Jub/N. From Eqn (|19j) we observe that the sum over can be neglected and 
for large nb/N, Emf reduces to 



^f = E fa m 2 - Ji^e^xf + H. c.) - (| - Kl 2 ) (22) 

The minimization of E C MF w.r.t. can now be easily carried out and the problem reduces 
to that of finding the classical ground state of H^p. Thus the large nb/N limit of the present 
large N equations is equivalent to the classical limit which involves n& — ► oo at fixed N . 
The fact that these two limits commute gives us further confidence on the usefulness of the 
present large iV procedure. 

Finally we indicate how this formalism can be used to evaluate the spin-stiffness of the 
LRO phases in the large N limit. One takes values of x° which minimize Emf and performs 
a slowly varying rotation: 

< -> ^exp ^^k.R^J x f (23) 

where n is the direction in spin-space about which the rotation has been performed, f are the 
Pauli matrices, and /c is a small wavevector. We insert this value of x° in Emf, reminimize 
w.r.t. the while maintaining the constraints and determine the change in energy AEmf 
for small k. We expect in general 

AE MF = ^Yp a p{n)k a kp H (24) 
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The co-efficient p is the spin-stiffness tensor of the LRO phase about the direction n. 

3. The J1-J2-J3 Model 

We now apply the formalism developed in the previous section to a frustrated antiferromagnet 
on the square lattice with first (J±), second (J2) and third (J3) neighbor interactions. This 
model has been examined by numerical [TT| W2\ , series ^3] and mean-field |Jj|| methods in 
the literature; their results will be compared with ours in section 3.D. We begin by presenting 
the results of the N = 00 mean field theory (section 3. A). The effective actions controlling 
the long-wavelength, long-time fluctuations at finite N will be considered in section 3.B. 
Berry phases and the spin-Peierls order they induce will be disussed in section 3.C. 

3. A Mean Field Theory 

The energy Emf for this model was minimized over all fields Qij and Aj which were periodic 
with a a/2 x a/2 unit cell. All of the global minima found in fact turned out to have a 
periodicity with one site per unit cell: we will therefore restrict our analysis to this simpler 
limit. In addition, full wavevector-dependent stability matrices involving quadratic fluctua- 
tions of E MF on the manifold specified by Eqn (j2T?j) were evaluated at representative points, 
and all eigenvalues found to be positive. This gives us reasonable confidence that the states 
described below are in fact the global minima of Emf- 

With one site per unit cell, the link variational parameters are the nearest neighbor 
fields Qi <x ,Qi,y, the diagonal 2nd neighbor fields Q2, y + X , Q2, y -x and the 3rd neighbor fields 
Qz,x, Qs,y The bosonic eigenmodes can be calculated exactly and we find the eigenenergies: 

^ k =(A 2 -4|A k | 2 ) V2 

A k = -h {Qi,x sin k x + Qi^y sin k y ) + J 2 (Q2, y +x sm(k y + k x ) + Q 2 , y - X sm(k y - k x )) 
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+ h (Qs,x sin(2fc x ) + Q 3>y sin(2fc„)) (25) 

The wavevector k extends over the first Brillouin zone of the square lattice. 

Our results for J3 = are summarized in FigH We begin by discussing the structure of 
the ground state at N = 00. We find 3 distinct types of phases: 

1. (7T,7r) 

These states have Q± iX = Q\. y ^ 0, Q2, y +x = Q2, y -x = Qz,x = Qz, y = and are the analogs 
of the states found in SU (N) systems. Inserting these values into Eqn (|23j) we see that u k 
has its minima at ±(7r/2, 7r/2): this implies that the spin-spin correlation function, which 
involves the product of two bosonic pair correlation functions 4J, will have a peak at (71*, n). 
We have a state with x° 7^ (LRO) for iV/n& < 2.5 and the corresponding SRO state for 
N/rib > 2.5. The boundary between LRO and SRO is independent of J2/J1, but this is 
surely an artifact of the large N limit. Finite N fluctuations should be stronger as J2/J1 
increases, causing the boundary to bend a little downwards to the right. While properties 
of these states can be calculated numerically for all values of J2/J1 and N/rib, we tabulate 
a few analytic results for the LRO phase in an expansion in powers of N/nj,- The ground 
state energy is 

E MF = —NN S \2Jx + 4(1 - 70 Ji (^) + • ■ ■] (26) 



where I\ = 0.84205 is obtained from an integral over the Brillouin zone. The spin-stiffness 
for spin rotations about an axis perpendicular to the Neel axis is found to be 



Ji - 2J 2 + [4J 2 (/ 2 - 1) - J x (h + 1 2 - 2)] ( - ) + 



(27) 



with J 2 = 1.39320. 
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2. (tt,0) or (0,vr) 



The (0,7r) states have Qi ia; = 0, 7^ 0, Q 2 ,y+x = Q2, y -x ^ 0, and Q 3iX = Q 3>y = and 
occur with LRO and SRO. The degenerate (tt, 0) state is obtained with the mapping x «-> y. 
For J2/J1 > 1/2, the classical limit, has independent Neel order on each of the A and B 
sublattices; quantum fluctuations, which are automatically included in the present approach, 
cause the Neel order parameters to align ( "order from disorder" ) leading to the LRO states. 
To understand the nature of the transition between LRO at (tt, tt) to LRO at (tt, 0) or (0, tt) 
we need the energy and stiffness of the latter states for small N/n^. We find 



E 



MF 



-NN X 



2 r 



J: + 2 J 2 + (2 Ji + 4J 2 - 4J 1 / 3 ) ( — ) + 



(28) 



where I3 is a Brillouin zone integral whose value depends upon J%j 3\\ we will only need its 
value at J%/ 1 J\ = 0.5: ^3 = 0.88241. The stiffness of the (0, u) state is soft at small n^/N for 
wavevectors in the x-direction: 



Pxx = N 



n b \ 2 1 



2 J 2 - h + 2 [J 2 (2 + h ~ 2/4) + Ji{h ~ 1)] ( — + • 

\ lift / 



(29) 



,A^y 2 

where I4, 15 are Brillouin zone integrals dependent upon J^J J\. Again we will only need their 
values at J 2 /Ji = 0.5 which are I4 = 1.28576 and 1$ = 0.32767. Comparing Eqns (J26j) and 
(l2"%j) we see that the energies of the (tt, 7r)-LRO and (0, 7r)-LRO states become equal at 

■h = Ji\l + 0.08072 (—) +■■] (30) 
L2 \n b J 

At this value of J 2 /Ji the stiffness of the (71", tt) state is found to be 



p Q/3 (7r,vr) = 0.1949iV(^)5 Q/3 + 



(31) 



while the stiffness of the (0, tt) state is 



^(0,70 = 0.2446^ + 



(32) 
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Thus both stiffnesses are positive and indicate that the transition between the states is first 
order. Note that in both stiffnesses the leading N(rib/N) 2 term is absent; these stiffnesses 
thus vanish classically and have appeared directly as a result of quantum fluctuations — 
another example of "order from disorder". These results contradict arguments in Ref. j22] 
that another 'spin liquid' phase exists at arbitrarily small N/rib near J2/J1 = 0.5. While we 
agree that quantum fluctuations are very important in a 'fan' emanating from J2/J1 = 0.5, 
N/iib = 0, we have found that these fluctuations just reinforce the classical order. At larger 
values of N/rib we have a continuous (at N = 00) transition to the (0, 7r)-SRO or (tt, 0)-SRO 
state. The transition between this state and (it, 7r)-SRO remains first-order. 

3. "Decoupled" 

For J 2 J ' J\ and N/n h both large, we have a "decoupled" state with Q2, y +x = Q2, y -x 7^ and 
Qi — Q3 — 0. In this case Q p is non-zero only for sites on the same sublattice. The two 
sublattices have Neel type SRO which will be coupled by finite N fluctuations. The N = 00 
state does not break any lattice symmetry. 

We now turn to J 3 7^ (Figs [21 El EJ) , where we find a new class of phases: 

4. Incommensurate phases 

It is known that for finite J3, the classical magnet has phases with incommensurate helical 
(coplanar) order jTHj. Our phase diagram for a small value of N/nb {N/rib = 1, Fig Ek) 
is similar to the classical one. All of the LRO phases undergo continuous transitions to 
SRO with the same spatial distribution of the Q p and the accompanying broken rotational 
symmetry of the lattice. These SRO phases are shown in Fig The two new classes 
of phases which did not appear at J3 = are: (i) ±(q,n) phases with Q\ x 7^ Qx tV 7^ 0, 
Q2,x+ y = Q% y -x 7^ 0, Q 3x ^ and Q 3t y = 0; the degenerate ±(ir,q) helix is obtained 
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by the mapping x <-»• y. (ii) ±(q, q) phases with Q 1)X = Q 1>y ^ 0, Q 2 , x + y ^ 0, Q 2 , y ~x = 0, 
Qz,x = Qz,y 7^ 0; this is degenerate with (q, —q) phases PH]. The wavevector q varies smoothly 
from to 7r and is determined by doubling the wavevector at which has a minimum; 
it is continuous across second-order phase boundaries (FigEK)- in contrast to the classical 
limit ^3], for N/n^ finite it requires a finite J3 to induce helical order; the first order transition 
from (it, 7r) to (71*, 0) order persists for small J3 as shown in the inset of Fig[2K- This suggests 
that quantum fluctuations induce an effective ferromagnetic J3 in the model with bare J3 = 0; 
a finite bare antiferromagnetic J3 is required to compensate for this. 

The broken discrete symmetries in states with SRO at (0,7r) and (q, 7r) are identical: 
both are two-fold degenerate due to a breaking of the x <-> y symmetry. The states are 
only distinguished by a non-zero value of Q% in the (q, it) phase and the accompanying 
incommensurate correlations in the spin-spin correlation functions. However Q 3 is gauge- 
dependent and so somewhat unphysical as an order parameter. In the absence of any further 
fluctuation-driven lattice symmetry breaking (see below), the transition between SRO at 
(0, 7r) and (q, it) is an example of a disorder line [22|; these are lines at which incommensurate 
correlations first turn on. 

Fig 01 shows the transition from LRO to SRO as a function of N/rib for J3 = 0.35Ji. 
Similar transitions also appear in Fig 0] which has J3 = J2/2. There are several notable 
features of these two phase diagrams: 

(i) An intermediate state in which Sp(N) symmetry is only partially restored (spin-nematic jH]) 
does not appear in the large iV limit. We expect the transition from (q, g)-LRO to (g, g)-SRO 
to be described by a NLo model on the manifold M nonco n. A d = 1 + e expansion of a similar 
NLa model [2Hj for N = 1 has been recently carried out and does not show any tendency 
towards such ordering. 
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(n)The Q p variables can all be chosen real in all the phases, indicating the absence of "cru- 
ral" [8, order. 

(Hi) The commensurate states squeeze out the incommensurate phases as N/n^ increases in 
both phase diagrams. We expect that this suppression of incommensurate order by quantum 
fluctuations is a general feature of frustrated AFMs. 

3.B Fluctuations - long wavelength effective actions 

This section will examine the form of the effective action controlling the long-wavelength 
fluctuations of the b a quanta and the link fields Q p . We will focus mainly on the SRO phases 
in the region close to the transition to the LRO phases. 

We begin by examining the (ir, 7r)-SRO phase; this phase has already been examined in 
considerable detail in Ref [7] for the SU(N) AFM; here we adapt the results to the Sp(N) 
AFM. As noted above, this phase has the mean field values Qi^ x = Q\, y = Qi, and uj^ has 
minima at ±G, with G = (n /2,n/2). Close to the LRO phases, fluctuations of the b a will 
be strong at ±G. We therefore parametrize 



where tp± are assumed to have slow spatial variations. The most important component of 
the fluctuations of the Qij are those of their phases. In particular, as noted in Ref [7j, the 
mean-field theory has an unbroken gauge symmetry; the transformation 



where 7, = 1(— 1) for n x + Ti V even (odd), leaves all {Qij) invariant. A staggered component 
of the phases of the acts as the vector potential associated with this gauge symmetry. 
We therefore write 



6? = ^(r-;)e iG ^ + ^(rl)e 



(33) 




e 



(34) 



Qi,i+x = Qi exp (ijiA x (fi + x/2)) 



(35) 
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where again A x is slowly varying; a similar equation holds for A y . The time- component of 
the gauge-field is the fluctuation in the Lagrange multiplier: 



Xi = X + ijiA T (fi) 



(36) 



We now insert the ansatzes (J33|), (J35|) and (J5fijl into the Lagrangian C associated with Haf 
and perform a gradient expansion on all the terms. The final result is most compactly 
expressed in terms of the fields 



V£ = « + ^_)/v / 2 



1fc 



2a 



(37) 



and has the form 



d 2 r 



a* 



' d_ 

dr 



iA T \^ 2a + X(\^\ 2 + \^ 2a \ 2 ) 



(VtfVa, + VL^2*)+^i0ia 2 [(V + z'A) ^ (V - iA) ^ 2a + (V - iA) (V + zl) V: 



a* 



(38) 



We now introduce the fields 



n a = (^-^ a *)/V2. 



From Eqn (|58j). it is clear that the the 7r fields turn out to have mass A + AJiQi, while the 
z fields have a mass A — 4JiQi which vanishes at the transition to the LRO phase. The 7r 
fields can therefore be safely integrated out, and £ yields the following effective action, valid 
at distances much larger than the lattice spacing: 



S, 



eff 



d 2 r 



J^df^\(d,-tA,)z a \ 2 + 



n 1 2 



(39) 



Here c = \/8JiQia is the spin- wave velocity, A = (A 2 — lGJfQf) 1 ^ 2 is the gap towards spinon 
excitations, and A? = A T /c; this action is of the form (fTUj) quoted in the introduction. Thus, 
in its final form, the long-wavelength theory consists of a massive z a scalar (spinon) coupled 
to a compact £7(1) gauge field. 

We now examine the changes in the above actions as one moves from the (it, 7r)-SRO phase 
into the (q, g)-SRO phase (Fig|2b) ( a very similar analysis can be performed at the boundary 
between the (it, 7r)-SRO and the (vr, g)- SRO phases). This transition is characterized by a 
continuous turning on of non-zero values of Qi t i +V+X , Qi,i+2x and Qi t i+2 y - It is easy to see 
from Eqn (|34J) that these fields transform as scalars of charge 2^ under gauge transformation 
associated with A^. Performing a gradient expansion upon the bosonic fields coupled to these 
scalars we find that the Lagrangian C of the (ir, 7r)-SRO phase gets modified to 

72 

C^C + J -^{$A- (X/^1 Q V< ) + $ B • ( J a ^2a^^) + CC.) (40) 

where $a,b = {-hQz,x + J2Q2, y +x, JzQz, y + J2Q2, y +x) with the sites on the ends of the link 
variables on sublattices A, B. Finally, as before, we transform to the z, tt variables, integrate 
out the 7i fluctuations and obtain 

S eff = J fj df W - iA^)z a \ 2 + ^-\z a \ 2 + I • {j a pz a Vz^) + c.c. + V($)| + . . . , 

(41) 

Here $ = ($a + $s)/(2JiQia) is a scalar of charge —2; terms higher order in $ have been 
dropped. We have also added a phenomenological potential V(<&) which is generated by short 
wavelength fluctuations of the b a quanta. This action is of the general form ()12)) . and as 
noted earlier, is the simplest one consistent with the requirements of £7(l)-gauge and global 
Sp(N) invariance. In a phase with ^ and real, we see from Eqn ()41|) that the minimum 
of the dispersion of the z a quanta is at a wavevector k = {(& x ), (^ > j/))/2: this will lead to 
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incommensurate order. The action (|41|) thus demonstrates clearly the intimate connection 
between the Higgs phenomenon and the appearance of incommensurate correlations. 

We now turn to the (0, 7r)-SRO phase; we will find that its properties are quite similar to 
the (tt, 7r)-SRO phase. We recall that this phase has the mean-field values Q2, y +x = Q2, y -x = 
Q2, Qi,y = Qi and Qi tX = 0. The excitation energies now have minima at ±G with 
G = (0,7r/2). We therefore parametrize the b a fields as in Eqn (jHHj) . but using the new 
value of G. This phase also has an unbroken U(l) gauge symmetry; the main difference is 
in the staggering pattern of the charges of the b a quanta. With the choice of the constants 
7i = 1(— 1) for Tiy even (odd) in Eqn (J34"j) it is easily verified that all mean-field expectations 
(Qij) remain invariant. The phases of the link fields are parametrized as in Eqn (J35j) in terms 
of a vector potential A but with the new 7,; the diagonal link fields have the parametrization 

Qi,i +y+x = Q 2 exp [i 7i {Ayifi + y/2 + x/2) + A x (n + y/2 + x/2))] (42) 

and similarly for Qi t i +y ^ x . The remaining analysis is essentially identical to that for the 
(it, 7r)-SRO phase and we obtain the same final effective action S e ff (Eqn (|39p) with an 
additional spatial anisotropy. The connection between the z a quanta and the lattice bosons 
and between A^ and the phases of the link fields are now of course different. 

The transition from (0, 7r)-SRO to (q, 7r)-SRO follows the treatment above of the transi- 
tion from (it, 7r)-SRO to (q, g)-SRO; the final action for the incommensurate phase has the 
same form as Eqn (j41j) . 

3.C Berry Phases 

For the unfrustrated SU(N) magnets, Berry phases associated with instanton tunneling 
events had particularly strong consequences in the SRO phase jSJ [7] . Very similar effects 
occur in the commensurate SRO phases of the J1-J2-J3 model. We consider the various 
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phases in turn: 

1. {n, 7r) 

This phase is essentially identical to the SU(N) case [7]. The instantons have Berry phases 
7ZbC s 7r/2 where ( s = 0, 1,2,3 on dual lattice points with (even, even), (even,odd), (odd,odd), 
(odd, ,even) co- ordinates. Condensation of the instantons leads to spin-Peierls order of 
column (shown in FigQ) or line type (not shown) for nf, = 1, 3 (mod 4) and 2 respectively, 
or a featureless VBS state for = (mod 4) , throughout the (tt, tc) SRO phase. The 
b a quanta are confined by the compact U(l) gauge force, with a confinement length scale 
determined by the instanton density |50] . 

2. "Decoupled" 

We can apply the analysis of subsection 3.C.1 to each sublattice separately, giving e.g. for 
Ub — 1 (mod 4) the type of spin-Peierls correlations shown in Fig There is a total of 
4 x 4 = 16 states for this case but coupling between the sublattices will reduce this to 8 
states, all of one of the two types shown. The state with the 'dimers' parallel to one another 
has more possibilities for resonance using the J\ bonds and is likely to be the ground state. 
For rif, = 2 (mod 4) , there will be 2x2/2 = 2 states, and for n& = (mod 4) , just one. 

3. (0,tt) 

As in the other collinear phases, this state possesses instantons which are the remnants of 
hedgehogs in the LRO phase. A natural location for these instantons is at the center of the 
horizontal links which have Q\ tX = 0; the spins at the ends of these links are ferromagnetically 
aligned and are most susceptible to large deformations. The Berry phase for a configuration 
of well separated instanton charges m s at co-ordinates R s can be calculated as before E] 
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and we find 

Sb = in b {m s liOs{ri)} (43) 

s i 

where 9 s (ri) is an angle which winds by 2ir as rj moves around R s , the sum over i extends 
over all the sites of the lattice and 7$ is the staggering associated with the (0, 7r) phase i.e. 
7i = 1(— 1) for even (odd). The sum over % can be evaluated in a manner similar to 
Ref Consider first an isolated instanton of unit charge at R s ; rewrite the summation in 
(|43)l as one over vertical links of the square lattice: 

Sb = in b £ ^ [fl.fr) - s (r i+§ )] (44) 

The symmetry of the mean-field (0, it) state with one instanton now requires that the con- 
tribution of the links be odd under reflection across the horizontal line running through R s . 
The majority of the links will cancel against their reflection partners, the only exceptions 
being the links which intersect the cut in the angle field # s (rj); these will yield an additional 
contribution of Z7m&. We expect that these symmetry considerations will also be valid for a 
configuration of well separated instantons. Combining the contributions of all the instantons 
we obtain finally 

S B = iim b ^2 m s [Rsx] (45) 

s 

where [R sx ] is the integer part of R x . In the SRO phase the instantons interact with a 
Coulombic 1/R potential; the instanton plasma can therefore be mapped onto a dual sine- 
Gordon model [7j in which the instanton Berry phases appear as frustrating phase-shifts in 
the arguments of the cosine term [Zj . This model can be analyzed in a manner which closely 
parallels Ref . The Berry phases lead to condensation of the instanton charges and to spin- 
Peierls order of the type shown in Fig ^ for odd, and a VBS state for n b even. Combined 
with the choice (0, it) or (n, 0) this gives degeneracies 2, 4, 2, 4 for n b = 0, 1, 2, 3 (mod 4) . 
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4. Incommensurate Phases 

As the action (}4*Tj) makes clear, these phases require an additional charge —2 field <3? for their 
description. In the SRO phases, the z a quanta can be integrated out and we are left with a 
lattice gauge theory of a compact £7(1) gauge field and a charge —2 scalar. The scalar fields 
can form vortices with flux quantum tt: instantons can change this flux by 2tt, so only a 
Z 2 quantum number is topologically stable j^I], in agreement with the analysis of the LRO 
phase. If the vortices proliferate it will be necessary to consider Berry phases associated with 
them and the instantons to understand the SRO phase. The following phases can occur in 
such a lattice gauge theory [TH] : 

(i) A Higgs phase in which the vortices and instantons are suppressed; Berry phase effects 
are therefore unimportant and this phase will be insensitive to the precise value of n&. The 
b a quanta carry charge 1 and are unconfined these are spinons transforming under the 
fundamental of Sp(N). No such excitations were found in the commensurate phases. Gauge 
excitations have a gap controlled by the magnitude of the Higgs field The incommen- 
suration is also controlled by as has been noted earlier. There is no breaking of lattice 
symmetries beyond those found at iV = oo. However with periodic boundary conditions the 
ground state has an additional factor of 4 degeneracy for all rib'- the additional states are 
obtained by changing the sign of all Q p fields cut by a loop wrapped around the system |31| . 
This phase is expected to survive in our phase diagram at finite N. 

(ii) A confinement phase with proliferation of vortices and instantons, confinement of spinons, 
and a gap towards gauge excitations controlled by the instanton density [SHj. A plausible 
scenario is that this phase in fact coincides with the (tt, 7r)-SRO phase and possesses spin- 
Peierls order driven by the Berry phases of instantons. 

(in) Additional intermediate phases driven by the Berry phases of the instantons and 
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vortices — this possibility is under investigation. 

3.D Comparison with numerical and series results 

Many numerical JT] and series analyses ^3] have appeared on the model with J 3 = for 
the spin-1/2 577(2) model i.e. N = 1, n& = 1 in the notation of this paper. They find (tt, 7r)- 
LRO at small J2/J1, (tt, 0)-LRO at large J2/J1 and an intermediate SRO phase around 
J2/J1 = 1/2. This is in agreement (see FigEJ with our prediction in section 3.A.1 that the 
phase boundary between (ir, 7r)-LRO and (ir, n)- SRO bends downwards at finite N with 
increasing Jij J\. Analyses of this intermediate phase at J2/J1 [TT| IT3] shows clear evidence 
of columnar spin-Peierls ordering [7] , also in agreement with the results of Ref 7\ and section 

3. C.I. An additional intermediate phase with (0,7r)-SRO has not been ruled out. 

It would clearly be interesting to find the new incommensurate SRO phases with un- 
confined spinons of this paper in numerical work on models with N — 1, n& = 1. Our 
results suggest that such phases will only occur in models with a finite J3. A numerical 
analysis of the J1-J2-J3 model along the line J3 = O.5J2 has recently been performed |12j . 
For comparison, we display the large N results for these models in FigHJ As in FiglH these 
investigators ^2] find correlations at (71*, tt) at small J%j J\ and at (0, ir) at large J2/J1. Their 
results at intermediate J2/J1 are inconclusive but suggestive of a (ir,q) phase. A systematic 
analysis to resolve this issue and to distinguish SRO from LRO would be useful. 

4. The t-J Model 

This section will extend our results to a limited class of doped AFMs. These are described 
by the t-J models in which electrons hop with matrix element t, have a nearest-neighbor 
antiferromagnetic exchange J, and have restrictions on their occupation number at each site 
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due to the strong Coulomb interactions. Ideally one would like to dope AFMs which have 
spins in the representations examined above, i. e. transforming under the symmetric product 
of rib fundamentals of Sp(N), and take the large N limit with n^/N constant. Parameters 
can then be chosen to obtain the experimentally observed [2] Neel LRO state in the undoped 
limit. These models require the introduction of bosons b a carrying Sp(N) spin, and spinless 
fermions to represent the holes The Pauli exclusion principle now restricts the density 
of fermions to be order 1 and it appears that a simple large- N limit does not exist. 

We examine here the doping of AFMs which have spins transforming under the antisym- 
metric product of m fundamentals of Sp(N) (this representation is not irreducible); the large 
N limit will be taken with m/N constant. Such spins are most conveniently described by 
introducing fermions f a transforming under the fundamental of Sp(N). The holes are now 
represented by spinless bosons b. The physical 'electron' is therefore 

cf = f?b\ (46) 

The local constraint of the t-J model is 

flft + b\h = m (47) 

for every site i. We will focus exclusively on the case in which the states are half filled at 
zero doping: m = N . This approach is an adaptation of the large N limits of Ref [H2J ESj for 
SU(N) t-J models. Unlike the SU(N) case, the states on each site do not form an irreducible 
representation of Sp(N) at zero doping. Two fermions can combine to form on-site singlets 
J af3 flaflp- There is, however, no energy gained out of forming such states; they in fact 
reduce the ability of the site to form energetically favorable singlet bonds with other sites. 

For undoped AFMs with exchange interactions of the type (JBJ), the large N limit can 
be taken following the SU(N) case. For weak frustration the ground states are fully 
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dimerized into pairs of sites forming singlet bonds. (Note that the bosonic large N theories 
of Section 3 also give only dimerized ground states in the limit of large N/nb for odd: see 
FigsE El El) Neel -type states which are important for N — 1 are not found. However at 
large dopings, the present large- iV offers a natural way of describing metallic states with a 
Fermi surface satisfying Luttinger's theorem, the existence of which appears to be suggested 
by some experiments on the high-T c materials [S3]. Thus the following calculation, while 
probably not experimentally relevant at small doping, might capture the correct physics at 
moderate and large dopings. 

We will consider the following Hamiltonian 

<ij> <ij> 

+ £a, (flf? + t>h -n)+hY, - NS ) ( 48 ) 

i i 

The last two terms enforce the local constraint (J47j) and fix the average hole density at NS. 
Here we will focus exclusively on the N = oo limit at zero temperature. This requires a 
complete condensation of the b bosons = y/Wbi and introduction of the link-field 

^ = (J a "flf%) (49) 

which performs the Hubbard-Stratanovich decomposition of the exchange interaction. We 
note that this decoupling is very similar to that performed in Refs [HI]; m the present 
calculation however it is uniquely enforced by the large N limit. As in Ref at T = 0, 
our solutions have 6j ^ (for 5^0) and Ajj ^ which describe a superconducting state. 
We have examined mean-field equations numerically with two sites per unit cell (with both 
the 2x1 and \[2 x \/2 unit cells) and determined the global ground states over this manifold. 
The results are summarized in FigEJ A large part of the phase diagram in fact turns out 
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to have a unit cell of just one site. In this case \ = v5, A^ +x = A a , A iti+y = A y and the 
quasi-particle energy spectrum is 



1 1/2 

(A — 2t5 (cos k x + cos k y )) + 4J 2 | A x cos + A y cos (50) 



We find 4 different types of superconducting states which are described below. With the 
exception of the first phase which has coexisting spin-Peierls order, all phases are combination 
of extended s (s*) and d wave pairing with no on-site pairing. 

(i) Coexistence of spin-Peierls order and superconductivity: This phase occurs for small t or 
small 5 and has a 2 x 1 unit cell with the spatial distribution of the Aij shown in Fig El All 
three Ai, A 2 , A 3 cannot be made real in any gauge so this phase also breaks time-reversal 
invariance. At t = and 5 arbitrary, or 5 = and t arbitrary, we have Ai ^ 0, A 2 = A3 = 0: 
the system is now a fully dimerized insulator. The quasi-particle spectrum is found to have 
a gap over the entire Brillouin zone. This is the only phase which has a unit cell larger than 
one site. 

(ii) s* + id-wave superconductor: Occurs around t/J ~ 1 and 5 ~ 0.5 and has A^ = 
e ld A y where the phase 9 varies smoothly with t/J and 5. Such a state has been considered 
previously by Kotliar 36 . The quasi-particle spectrum is fully gapped and time- reversal 
symmetry is broken. 

(Hi) d-wave superconductor: This phase occurs for moderate and large tj J at small 5 and has 
A x = —A y and has been considered previously by Kotliar and Liu jSZj. The quasi-particle 
gap vanishes at 4 isolated points (±/c°, ±k°) in the Brilluoin zone. 

(iv) s*-wave superconductor: Finally for large 5 we obtain an extended s-wave solution with 
no on-site pairing which has A x = A y . There is again a fully gapped excitation spectrum; 
for large t5/J, the gap vanishes as t5 exp(— ct5 / J) where c is a constant of order unity. 
Finally we address the issue of the stability of the phases discussed above towards phase 
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separation. A realistic model of the high-T c materials should also include the long-range 
Coulomb interactions between the electrons and between the rare-earth ions and the elec- 
trons. These interactions will reduce any tendency towards phase separation. It is neverthe- 
less interesting to examine this issue for H t j alone. The results of a Maxwell construction 
on the energy-versus-doping curve are shown in Fig |S| The region below the dotted line 
is susceptible to separation into an insulating antiferromagnet with 5 = and a hole-rich 
phase with 5 on the dotted line. The boundary towards phase separation approaches 5 = as 
tj J — > oo, in agreement with Ref j2H]- However at small values oft/J, in particular at t = 0, 
we find no phase separation, unlike Emery et. al. jSHj- The absence of phase separation at 
t = in the present calculation is due to the extra stability acquired at large N by fully 
dimerized solutions with every site less than half-filled. 

5. Conclusions 

This paper has presented details on the application of a new large N expansion based on 
the symplectic groups Sp(N) which was introduced recently [TU]. These groups naturally 
generalize to all values of N the physics of SU(2) = Sp(l) antiferromagnetism: the pairing 
of spins with opposite directions in spin space. They lead to a particularly appealing treat- 
ment of frustrated antiferromagnets with all antiferromagnetic exchange interactions treated 
democratically. The large N limit was taken by placing spins on each site which transform as 
rib symmetric products on the fundamental of Sp(N), and fixing n^/N at an arbitrary value 
(rib = 25 for SU(2)). For large rib/N the ground states become identical to the classical 
solutions and possess magnetic long range order (LRO). Upon reducing n^/N all the LRO 
states under continuous transition to short range ordered (SRO) states whose properties are 
closely connected to the LRO states. In particular for the square lattice model with first, 
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second, and third neighbor interactions (Figs [TJ |2J El H| we found two distinct classes of 
states: 

(%) LRO states with commensurate, collinear order led at smaller values of n^/N to SRO 
states with a gap to all excitations, spinons confined by a compact £7(1) gauge force, and 
spin-Peierls or valence-bond-solid order controlled by the value of (mod 4) . 
(ii) LRO states with incommensurate, coplanar order led at smaller values of rib/N to SRO 
states with a gap to all excitations, unconfined spinons and no spin-Peierls order. A charge 
—2 scalar in a Higgs phase was responsible for liberating the spinons jTHj. These incommensu- 
rate SRO states appear to contradict the 'fractional quantization principle' of Laughlin |21j . 
This principle asserts that spin- 1/2 excitations of a non-degenerate 'spin-liquid' ground state 
must interact with a gauge force which endows them with fractional statistics. The SRO 
states found in this paper have a two-fold degeneracy but this can easily be lifted by adding 
small explicit symmetry breaking terms to Haf (this can be done for the (q, 7r)-SRO phase 
by modifying J 3 on just the x-directed links, and for the (q, g)-SRO phase by changing J 2 on 
the links in the (1, 1) direction). The modified model now has a non-degenerate ground state, 
no gapless excitations, and unconfined spin- 1/2 spinon excitations with bosonic statistics, 
contradicting Ref |2T| . 

Additional intermediate phases between the Higgs and confinement SRO phases are possible 
and are presently under investigation. No chirally ordered jHJ or spin-nematic [Oj states were 
found. 

An initial discussion of the application of the symplectic groups to doped antiferromag- 
nets was also presented. In this case they allow a natural implementation of both antiferro- 
magnetic exchange and hole hopping terms, and emphasize the natural connection between 
antiferromagnetism and singlet superconductive pairing J3J. In particular a study of the 
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T = 0, N = oo limit of a t — J model with spins represented by fermions and holes by 
spinless bosons yields superconducting ground states (FigEJ in much the same manner as 
Ref ^H]- Extension of these results to finite temperature and finite N is clearly of great 
interest and is currently in progress. 
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Figure 1: Ground states of H for J 3 = as a function of J%j J\ and N/n^ {n^ = 2S for 
Sp(l) = SU(2)). Thick (thin) lines denote first (second) order transitions at N = oo. Phases 
are identified by the wavevectors at which they have magnetic long-range-order (LRO) or 
short-range-order (SRO). The links with Q p ^ in each SRO phase are shown. The large 
N/rib, large J%j J\ phase has the two sublattices decoupled at iV = oo; each sublattice has 
Neel -type SRO. Spin-Peierls order at finite N for odd n& is illustrated by the thick, thin 
and dotted lines. The (71", 7r)-SRO and the "decoupled" states have line-type jZj spin-Peierls 
order for rif, = 2 (mod 4) and are VBS for rib = 0(mod 4). The (0, 7r)-SRO state is a VBS for 
all even nf,. 
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Figure 2: As in Fig ^ but as a function of J-ij J\ and J3/J1 for (a) N/n^ = 1 and (b) 
N/rib = 5. The inset in (a) shows the region at the tip of the arrow magnified by 20: a 
direct first-order transition from (tt, 7r)-LRO to (0,7r)-LRO occurs up to J3/J1 = 0.005. 
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Figure 5: Ground state of the t — J model H t j at N = oo as a function oft/ J and the hole 
concentration 5. All phases except on the lines t — and 5 = are superconducting. The 
region below the dotted line is susceptible to separation into an insulating antiferromagnet 
with 5 = and a hole-rich phase with 5 on the dotted line. The boundary towards phase 
separation approaches <5 = 0ast/J^oo 
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